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Multiple Access Channel with Partial and 
Controlled Cribbing Encoders 

Haim Permuter and Himanshu Asnani 
Abstract 

In this paper we consider a multiple access channel (MAC) with partial cribbing encoders. This means that 
each of two encoders obtains a deterministic function of the other encoder output with or without delay. The partial 
cribbing scheme is especially motivated by the additive noise Gaussian MAC since perfect cribbing results in the 
degenerated case of full cooperation between the encoders and requires an infinite entropy link. We derive a single 
letter characterization of the capacity of the MAC with partial cribbing for the cases of causal and strictly causal 
partial cribbing. Several numerical examples, such as quantized cribbing, are presented. We further consider and derive 
the capacity region where the cribbing depends on actions that are functions of the previous cribbed observations. 
In particular, we consider a scenario where the action is "to crib or not to crib" and show that a naive time-sharing 
strategy is not optimal. 

Index Terms 

Backward decoding, Block-Markov coding, Cribbing encoders, Cribbing with actions, Gaussian MAC, Quantized 
cribbing, Partial cribbing, Rate splitting, Superposition codes, "To crib or not to crib" . 

I. Introduction 

In his remarkable dissertation [1 j, Willems introduced a new problem of the multiple access channel (MAC) with 
cribbing encoders and derived its capacity region using a novel decoding technique called "backward decoding". 
Cribbing encoder refers to the case where the encoder knows perfectly the other output encoder, possibly with delay 
or lookahead. The work by Willems on MACs with cribbing encoders has been extended to the interference channel 
12), and to state-dependent MAC Q. However, for the Gaussian case, where the encoder output is of a continuous 
alphabet, the cribbing idea is not an interesting case J4] since it implies a full cooperation between the encoders 
regardless of the delay of the cribbing. This is due to the fact that in a single epoch time a noiseless continuous 
signal may transmit an infinite amount of information. Motivated by this fact, we introduce in this paper "partial 
cribbing", where one encoder only knows a quantized version, or, more generally, a deterministic function of the 
coded output of other encoder. 

In this paper we consider two kinds of partial cribbing: causal and strictly-causal. Causal partial cribbing means 
that at time i the encoder observes (and uses) the partial cribbing signal without delay, i.e., Zi. Strictly-causal 
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Fig. 1. Partial (deterministic-function) cribbing. Each encoder observes a deterministic function of the other encoder with or without delay. 
Encoder 1 observes the cribbing in a strictly causal way, i.e., with delay, and Encoder 2 observes the cribbing causally, i.e., without delay. The 
setting corresponds to Case B in this paper. 



partial cribbing means that at time i the encoder observes the partial cribbing with a delay, i.e., We derive 

the capacity region for two different cases according to the causality or the strictly causality of the cribbing 

Case A: The cribbing for both encoders is strictly-causal. 

Case B: The cribbing for one encoder is causal and for the other encoder is strictly-causal. 

The setting that is depicted in Fig. Q] is the case where one encoder has causal partial cribbing and the other 
strictly causal partial cribbing, namely Case B. To some extent, the partial cribbing problem is related to the semi- 
deterministic relay channel ||5] which was solved using the partial decode and forward technique [6]. The partial 
cribbing setting has a similar structure to the semi-deterministic relay channel where Encoder 2 plays the role of 
relay and receives a deterministic function of the output of Encoder 1 . However, the MAC with partial cribbing is 
different from the semi-deterministic relay in the sense that Encoder 2 has its own message to transmit in addition 
to its role of relaying information from Encoder 1. Another related problem is the semi-deterministic broadcast 
channel [71, where one of the receivers obtains a deterministic function of the input channel. In our problem Encoder 
1 "is broadcasting" to Encoder 2 and to the decoder hence this part of the communication resembles the semi- 
deterministic broadcast channel. However, in our problem of partial cribbing only the decoder is actually required 
to decode the message error-free. 

The coding scheme presented here for the partial cribbing uses the same techniques that were used for the perfect 
cribbing, i.e., block Markov coding, Shannon's strategies, super position coding, and backward decoding, and in 
addition to that, we use rate splitting in the code design. Rate splitting is needed since Encoder 2 can decode only 
part of the message transmitted by Encoder 1. 

Recently, several problems on "action" in information theory have been considered in llHI — ifTTI . In these problems 
the side information is not freely available but depends on an action that has a cost. The solution of partial cribbing 
allows us to consider the case where the cribbing is action dependent. Namely, there is an action that is a function of 
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the previously cribbed observations and this action determines the current cribbing function. This kind of questions 
may be raised in cognitive communication systems where sensing other users signals is a resource with a cost. In 
particular we show through a simple example where the action is "to crib or not to crib" that a time-sharing action 
is not necessarily optimal. 

The remainder of the paper is organized as follows: In Section [Til we introduce the setting of MAC with partial 
cribbing and state the capacity region for strictly-causal (Case A), as well as mixed causal and strictly-causal (Case 
B). In sections iHll and HV1 respectively we provide the converse and achievability proofs of the capacity region for 
each case of partial cribbing. In Section M we consider the case where a common message, known to the encoders, 
needs to be transmitted to the decoder in addition to the private messages. We show that no additional auxiliary 
random variable is needed to characterize the capacity region since the partial cribbing is utilized via generating a 
common message between the users. In Section IVT1 we consider the case where one of the encoders has no message 
to send; hence it becomes a special case of the semi-deterministic relay channel with and without delay. We show 
that indeed the region obtained via partial cribbing and the region obtained via a semi-deterministic relay channel 
coincide. In Section IVIII we consider a Gaussian MAC with quantized cribbing. We provide a simple achievable 
scheme and show numerically that even with a few bit quantizer we obtain an achievable region that is very close 
to the perfect cribbing capacity region. In Section IVIIII we consider a scenario where a limited-resource action 
controls the cribbing. In particular, we investigate an example where the action is "to crib or not to crib" and solve 
it analytically. In Section [IX] we conclude the paper and suggest some research directions that have not been yet 
solved such as noncausal partial cribbing, noisy cribbing and a few action related problems. 

II. Problem definition and Main Result 

The MAC setting consists of two transmitters (encoders) and one receiver (decoder). Each transmitter I <G {1,2} 
chooses an index mi uniformly from the set { 1 , . . . , 2 nR 1 } and independently of the other transmitter. The input to the 
channel from encoder I e {1, 2} is denoted by {^Q,i, -Xj,2i ^Q,3i •••}■ Encoder 1 and Encoder 2 obtain a deterministic 
function of the output of Encoder 2 and 1, respectively, of the form Z^^i = #2(^2,4), and Z\i = gi(Xi^). The 
output of the channel is denoted by {Y\, Y2, Ys, ...}. The channel is characterized by a conditional probability 
P{yi\xi,i, %2,i)- The channel probability does not depend on the time index i and is memoryless, i.e., 

P{y l \x l 1 ,x i 2 ,y^ 1 ) = P(yi\x h i,x 2 ,i), (1) 

where the superscripts denote sequences in the following way: x\ = (xj 1, 3^,2, %i,i)> I & {1, 2}. Since the settings 
in this paper do not include feedback from the receiver to the transmitters, i.e., P{x\^, X2,i\x\~ 1 , x 2 ~ x , y 1 ^ 1 ) = 
P(xi.i, X2,i\x\~ 1 , x l 2 x ), Equation ([B implies that 

PiVi^x^y*- 1 ) = P(yi\x hi ,X2,i). (2) 

Definition 1: A (2 nRl , 2 nR2 , n) code with partial cribbing , as shown in Fig. Q] consists at time i of an encoding 
function at Encoder 1 

Case A, B, / M : {!,... ,2 nRl } x Z'if 1 ^ X M , (3) 
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and an encoding function at Encoder 2 that changes according to the following case settings 

Case A : {1, 2 nR °} x Zp 1 i— > X 1)h 
CaseB /_,., : {1 2"' 1 ' | < Z[ ■ > X..,. 

and a decoding function, 

g : y n i-> {l,...,2 nRl } x {l,...,2" fl2 }. 
The average probability of error for (2 nRl , 2 ni?2 , ri) code is defined as 



p(n) 



1 



2n(«i+-R2) 



Pr{<7(F™) =^ (mi,m2)|(mi,m2) sent}. 



(4) 



(5) 



(6) 



mi,m2 

A rate (Ri,R 2 ) is said to be achievable for the encoder with partial cribbing if there exists a sequence of 
(2 nRl , 2 ni?2 , n) codes with P e — > 0. The capacity region of the MAC is the closure of all achievable rates. 
The following theorem describes the capacity region of MAC with partial cribbing for two different cases of 
causality. 

Let us define the following regions 1Za,7Zb, which are contained in R^_, namely, contained in the set of 
nonnegative two dimensional real numbers. 

Ri < H(Zt\U) + I(X i; Y\X 2 ,Z u U), 
R 2 <H(Z 2 \U)+I(X 2 ;Y\X 1 ,Z 2 ,U), 
R 1 +R 2 <I(X 1 ,X 2 ;Y\U,Z 1 ,Z 2 ) + H(Z 1 ,Z 2 \U), 
Ri +i? 2 < I{X U X 2 \Y), for 
P(u)P(xi, z 1 \u)P(x 2 , z 2 \u)P(y\xi,x 2 ). 
The region TZb is defined with the same set of inequalities as in (O, but the joint distribution is of the form 



P(u)P(xi,z 1 \u)P(x 2 ,z 2 \z 1 ,u)P(y\xi,x 2 ). 



(8) 



Theorem 1 ( Capacity region ): The capacity regions of the MAC with strictly-causal (Case A), mixed causal and 
strictly-causal (Case B) partial cribbing as described in Def. Q]are Ti-A, Ti-B, respectively. 
Lemma 2: To exhaust 1Z a and TZb it is enough to restrict the alphabet of U, to satisfy 



\U\ < min(|y| +3,1^11^1 +2)). 
The proof of Theorem Q] and Lemma [2] is given in the next section. 



(9) 



III. Converse 

Here we provide the converse proof of Theorem [T] for the two cases, A and B. 

Converse proof of Case A: Assume that we have a (2 nRl , 2 nR2 , n) code as in Definition Q] Case A. We will 
show the existence of ajoint distribution P(u)P(zi\u)P(z 2 \u)P(xi \z\, u)P(x 2 \z 2 , u)P(y\xi, x 2 ) that satisfies the 
inequalities of © within some e n , where e n goes to zero as n — > oo. Consider 



n(R!+R 2 ) = H(M U M 2 ) 
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= H{M l7 M 2 ) + H(M x ,M 2 \Y n ) - H(M lt M 2 \Y n ) 
( "' I(M 1 ,M 2 ;Y n )+ne n 
( =' I(X?, X2;Y n )+ne n 

n 

= ^/(X 1 ",X 2 ";y i |y i - 1 )+ne„ 

(c) n 

< Y / I{X lti ,X 2 , i ;Y i )+ne n (10) 
i=i 

where (a) follows from Fano's inequality, (b) from the fact that (X[ l , X 2 ) is a deterministic function of (M\ , M 2 ) and 
the Markov chain Y n - (X?, X%) - (Mi, M 2 ) and (c) from the Markov chain Y t - (X M , X 2 ,i) - (Xf , X 2 ™, Y 1 - 1 ). 
Now consider, 

n(R 1 +R 2 ) = H{M\,M 2 ) 

( = } H(Mi,M 2 , Z™ , Z 2 ) 

= H(Z?, Z") + ff(Mi, M 2 |Z?, 2%) 

( =' ff(Z?, Z 2 l ) + I(Mi, M a ; y n |^, Z 2 ") + ne„ 

= (Zf, ZJ) + X 2 "; y"|^r, Z2 ) + ne n 

n 

= £ ff(Z M , Z 2>i |Zr 1 ,Zr 1 ) + /(-«?, X 2 "; r^" 1 ^", Z 2 >) + ne„ 

i=l 
n 

< H ( Zl >i> z ^\Zl\ Z\- x ) + IiX^X^-YilZizl) + ne n , 

i=l 
n 

C = 5 £ir(2 Mj Z2, < |^)+/(X Mj Jf 2iT ,;i;|Z 1|< ,Z 2)< ,U' i )+ne ni (11) 

i=l 

where (a) follows from the fact that (Z™, Z 2 ) are a deterministic function of (Mi, M 2 ), (b) from Fano's inequality, 
and (c) from the following definition of a random variable 

Ui ± (zrszr 1 ). d2) 

Furthermore, consider 

niii = ff(Mi) 

( => H{M 1 \M 2 ) 

{ =' fl-(Mi,^|M2) 

= H(Z?\M 2 ) + H(M 1 \Z?,M 2 ) 

= H(Z[ l \M 2 ) + H(Afi|M 2j ZH + #(Mi|F n ,M 2 , Z?) - #(Mi|F n ,M 2 , Zf) 

n 

H{Z 1 , i \Z\- 1 ,M 2 ) + IfXi- MilF*" 1 , M 2 , Z} 1 ) + ne„ 



(J 

i=l 
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i=l 



5^ //(Z^IZj" 1 , Zl-\M 2 ) + I(Y i ;M 1 ,X hi \Y i - 1 ,M 2 , X 2 , h Z?, Z") + ne n 

i=l 
n 

< £ //(Z^Zj- 1 , Z*" 1 ) + I{Yi;X lti \X 2ti , Z{, Z\) + ne n 
i=l 
n 

= 5^fl-(Zi, i |l7 i )+7(y i ;X M |X2 1 i ) l7 < ,Z M )+ne n (13) 
»=i 

where (a) follows from the fact that the messages Mi and M 2 are independent of each other, (b) follows from the 
fact that Z" is a deterministic function of (Mi, M2), (c) follows from Fano's inequality, and (d) from the fact that 
X\,i is a deterministic functions of (Mi, Z^ 1 ) and X 2 ^ is a deterministic function of (M 2 , Z\~ l ). Step (e) follows 
from the Markov chain Yi — (Xij, X 2 .i, Z n ) — (Mi, M 2 ,Y' l ~ 1 ) and the fact that conditioning reduces entropy. 
Similarly to (fljji we obtain 

nR 2 < ^H(Z 2)i |C/i)+/(F i ;X 2!i |X M ,C/ i ,Z 2ji )+ne„. (14) 

i=l 

Now let us verify that the three Markov chains Zl^— Ui — Z 2 _i, Xi i— (Ui, Zi — (X2 and X 2 ^ — (Ui, Z 2 ^) — (Xi^) 
hold. The first Markov chain is due to the Markov (M x , Z*' 1 ) - (Zj _1 , Z*" 1 ) - (M 2 , Zj" 1 ) or equivalently Mi - 
(Zi~ 1 ,Z l 2 ~ 1 )-M 2 and the second Markov chain is due to the Markov chain (Mi, Z^" 1 )- (Zf, Z^ 1 ) - (M 2 , Z} -1 ) 
or equivalently Mi — (ZJ, Z-p 1 ) — M 2 . The Markov chain follows from the joint distribution P(m\, m 2 , zf, z 2 ) = 
P(mi)P(m 2 ) nr=i P( z hi\ z 2~ > m i) n"=i PC^il^i , and the observation that 



P(mi|zr,^,m 3 ) 



(p(m 2 )a n =iPK^r 1 I m 2 ))E, r[1 p^ontiP^i.^r 1 .^) 
nr^pK^r'^i) 



(15) 



Em, P("*l)n?=lP(«l,il4 _1 »"»l). 
does not depend on m 2 . The third Markov chain is an exchange between the indexes 1 and 2, namely, Mi, Xij, Zi t % 

is exchanged with M 2 , X 2 ,i, Z 2 ,u respectively. Finally, let Q be a random variable independent of (X™ ,X% ,Y n ), 

and uniformly distributed over the set {1, 2, 3, .., n}. We define the random variables U = (Q, Uq) and obtain that 

the region given in (0 is an outer bound to any achievable rate. ■ 

Once Case A is proved, Case B follows straightforwardly using the following modification. 

Converse proof for Case B: We repeat the same converse as for Case A, except that in the final step we need to 
show the Markov chain X 2> i — (Ui, Z\^, Z 2 ^)—X\^ rather than X 2 ^ — (Ui, Z 2i i) — X\i as in Case A. Since for case 
B the Markov chain (M 2 , Z{)- (Z\,Z\) - Mi holds it follows that X %i - (M 2 , Z{) - (Ui, Z) - (M x , Z^ 1 ) - X 14 
holds too. ■ 

Now we prove Lemma [2] which allows us to bound the cardinality of the auxiliary random variable U without 
decreasing the rate regions 1Za,TZb- 

Proof of Lemma^ We invoke the support lemma [12, pp. 310]. The external random variable U must have \y\ — 1 
letters to preserve P(y) plus four more to preserve the expressions H(Z\\U) + I(X\\ Y\X 2 , Zl, U), H(Z 2 \U) + 
I(X 2 ;Y\X 1 ,Z 2 ,U), I(X X ,X 2 ;Y\U,Z X ,Z 2 ) +H(Z 1 ,Z 2 \U), and H(Y\X 1 , X 2 ,U,). Alternatively, the external 
random variable U must have jAfiH^I — 1 letters to preserve P(x\,x 2 ) and three more to preserve the expressions 
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H(Z l \U) + J(Xi; Y\X 2 , Z lt U), H{Z 2 \U) + I(X 2 ;Y\X 1 , Z 2 , U), I(X U X 2 ; Y\U, Z U Z 2 ) + H(Z U Z 2 \U). Hence 
the cardinality of U may be bounded by min(|3^| + 3, |<li||A?2| + 2)). ■ 

IV. ACHIEVABILITY PROOF OF THEOREmQ] 

In this section we provide the achievability proof of Theorem Q] for the two cases, A and B. Throughout the 
achievability proofs in the paper we use the definition of a strong typical set. The set T^ 1 (X, Y, Z) of e-typical 
n— sequences is defined by {(x n , y n , z n ) : —N(x, y,z\x n ,y n , z n )—p(x, y, z)\ < ep(x, y, z)V(x, y, z) g X xyx Z}, 
where N(x, y, z\x n , y n , z n ) is the number of appearances of (x, y, z) in the n— sequnce (x n ) y n , z n ). Additionally, 
we will use the following well-known lemma lfT2l - lfT31 . 

Lemma 3 (Joint typicality lemma): Consider a joint distribution Px.y.z an d suppose (x n , y n ) € T^ n \x, Y). Let 
Z n be distributed according to Yl7=i Pz\x(zi\ x i)- Then, 

Pr{(x n ,y n ,Z n ) g T$ n \X,Y,Z)} < 2- n VV0\x)-Kc)) t (16) 

where lim e _».o 6(e) = 0. 

For the achievability proof, we use the rate-splitting coding technique in addition to the techniques used by 
Willems 02), i.e., block Markov coding, super-position coding, Shannon's strategies and backward decoding. The 
rate splitting technique introduces additional rate variables which are redundant and we eliminate them using the 
Fourier— Motzkin elimination. 

Achievability Proof of Case A: Let us split rate R\ into two rates R[ and i?" such that i?i = R[+R" and similarly 
R 2 into R' 2 and R' 2 ' such that R 2 = R' 2 + R%. Let m[ € [1, 2 ni? 'i], m'{ € [1, 2 nR "}, m! 2 g [1, 2 nR z], and 
m 2 g [1, 2 nR i]. Note that there is a one-to-one mapping between (m^m") and m\ and between (m' 2 ,m 2 ) and 

7712 . 

Code construction: Divide a block of length Bn into B blocks of length n. We use random coding to generate 
independently the code for each subblock b. Construct 2"( i? i +i? s>) codewords u n according to i.i.d. ~ P(u). For 
every codeword u n construct 2™ R i codewords z" according to i.i.d. ~ P(zi\u) and similarly 2 nR ^ codewords z 2 
according to i.i.d. ~ P(z 2 \u). Furthermore, generate 2 nRl codewords .t™ according to i.i.d. ~ P(x\\zi,u) and 
similarly 2 ,li?2 codewords x 2 according to i.i.d. ~ P(x 2 \z 2 ,u) . The Markov structure of the code is 

x™ is determined by (m^ b , m" b ) conditioned on (m^ m' 2 b _ 1 ) 

x 2 is determined by (m' 2 b , m 2 b ) conditioned on (m^ b _ 1 , m' 2 b _i). (17) 

Encoder: At block b G [1,...,B] encode the message (m'-y b _ 1 , m' 2 b _ 1 ) g [1, .., 2 n ^ R ^ +R '^ > ] using 
un ( m i 6-1' TO 2 6-i)> encode m[ b conditioned on (m[ b _i,rn' 2 b _i) using a;"(u n ,m^ b ), and encode m" b condi- 
tioned on (m'-y b , m'-y b _^ m ' 2 b-i) usm g %i(zTi u", m" b ). Similarly, encode m! 2 b conditioned on (m^ b , , m 2 b _\) 
using z 2 (u n , m'i b ), encode m 2b conditioned on (m! 2 b , m! x b _ 1 , m' 2 b _ 1 ) using x 2 (z 2 , u n , m 2 b ). We assume that 
m'j = m' 2 o = l and m[ b = m' 2 b = 1 which allow a backward decoding as explained next. 

Decoder: The receiver waits till the end of the block Bn and starts decoding each message in the sub-blocks 
going backwards b g [B, B — 1, B — 2, 1]. At block b, we assume that (m^ b , m' 2 b ) is already known to the 
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receiver from block 6 + 1 and it needs to decode , m! x b _ 1 , m 2 b _ 1 , m' 2 ' b and b . The decoder uses joint typicality 
decoding, hence at block b it looks for (rh^ b _i,rh 2 b _ 1 ), rh 2 B and rh 2 B for which 

(18) 

If no such triplet, or more than one such triplet is found, an error is declared at block b and therefore at the whole 
superblock nB (we consider (m'j b _ 1 ,m' 2 b l ) as one index in [1, ...,2 nRl+nR2 ]. The estimated message at block 
b sent from Encoder 1 is (mi ia , rhi,&), and the estimated message transmitted from Encoder 2 is (ro2, a ,m2,f))- 

Error analysis: The following lemma will enable us to bound the probability of error of the super-block nB by 
bounding the probability of error of each block. 

Lemma 4: Let {Aj}j =1 be a set of events and let Aj denotes the complement of the event Aj, Then 

J n 3'— 1 n 

P(\jAj)<Y,P(Aj\r\At) = J2P(AMt,A C 2,-,AU)- (W) 

3=1 3=1 «=1 3=1 

Proof: For simplicity let us assume that J = 3. In a straightforward manner the proof extends to any number 
of sets J. For any three sets of events Ai,A 2 ,A 3 we have 

P(A x uA 2 uA 3 ) = P(A 1 u(A 2 nA c 1 )u(A 3 nA c 1 nA c 2 )) 

= P(A 1 ) + P(A 2 r\A c 1 ) + P(A 3 nA c 1 nA c 2 ) 



P(i4f) P(A; n A§) 
p(Ai) + p(a 2 |a;) + p(As|a; n ad 

P(A 1 ) + P{A 2 \A c 1 ) + P{A 3 \A c ll A < 2 ) (20) 



Using Lemma |4] we bound the probability of error in the supper block Bn by the sum of the probability of 
having an error in each block b given that in previous blocks (b + 1, B) the messages were decoded correctly. 

First let us bound the probability that for some b, Transmitter 1 decodes the message m' 2 b incorrectly or 
Transmitter 2 decodes the message m\ b incorrectly at the end of block b. Using Lemma H] it suffices to show 
that the probability of error-decoding in each block b goes to zero, assuming that all previous messages in block 
(1, 2, b — 1) were decoded correctly. 

Let Ei b be the event that Transmitter 1 has an error in decoding m' 2 b and let E 2 b be the event that Transmitter 2 
has an error in decoding m! x b . The term P(Px,6 U E 2 ,\\E^ b l ) is the probability that Transmitter 1 or 2 incorrectly 
decoded m! 2 b and m\ b , respectively, given that b _ 1 and m' 2 b _ 1 were decoded correctly. Without loss of 
generality let's assume that m\ b = m! 2 b = 1. An error occurs if and only if there is another message m\ b > 1 that 
maps to the same codeword as z"(l,w") or there is another message m! 2 b > 1 that maps to the same codeword 
as z£(l,« n ). The probability that z?(i,u n ) = z[ l (l,u n ) where i > 1 and where (z?(l,u n ),u n ) € T e (n) (Zi, U) is 
bounded by 2~ n ( H ( Zl \ u ^~ s ( e " , where 6(e) goes to zero as e goes to zero. Hence 

P(E lib UE 2ib \El b _ 1 ,El b _ 1 ) < P(E 1 MEl b _ l7 El b _ 1 ) + P(E 2 , b \El b _ 1 ,El b _ 1 ) 
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2 nn i 2 "2 

< V 2- n{H{Zl \ u) - S{t)) + 2-™ (H(Z2|c/) - ,5(e)) 

i=2 i=2 

< 2"( fl i-"( ff ( Z il C/ ))+' 5 ( e )) + 2™ (/? 2-"( ff ( Z 2|(7)+<5(e))) ; pi) 

where inequality (a) follows from the union bounds. Now we bound the probability that the receiver decodes the 
messages (m^ b _ 1 , m' 2 b _ 1 ), or m 2 b or m 2 6 incorrectly at block b given that at block 6+1 the messages (m\ 6 , m 2 b ) 
were decoded correctly and given that Transmitter 1 and 2 encodes the right messages (m^ b _ 1 , m 2 b _ 1 ) in block 
b. Without loss of generality assume (m' 1 b-i> m 2 b-i) = 1 (f° r simplicity we index both messages by one index), 
m 2 b = 1 and m 2 h = 1 . Let us define the event 



k , b 4 { (u n (i), m' lih ), z%(u n , m' 2 , b ), z? , j) , x% (u n , z?, k),y n ) € T £ W(^ Z 1; Z 2 , X 1 ,X 2 , Y)} . 

(22) 

An error occurs if either the correct codewords are not jointly typical with the received sequences, i.e., Ef llb , or 
there exists a different (i, j, k) ^ (1, 1, 1) such that Eij,k,b occurs. Let P^j be the error-decoding at block b given 
that in blocks (b + 1, B) there was no error-decoding. From the union of bounds we obtain that 

i=l.j=l.k>l t=l,j>l,fc=l i=l,j>l,fe>l i>l.j>l,A;>l 

(23) 

Now let us show that each term in d23l goes to zero as the blocklength of the code n goes to infinity. 

• Upper-bounding Pr(Ef x 1 ): Since we assume that the Transmitter 1 and 2 encode the right (mj b~i' m 2 
and the receiver decoded the right (vn! x b , m 2 b ) in block b + 1, by the LLN Pr(E^ x j b ) 0. 

• Upper-bounding J2i=i j=i k>i Pr (^j',fc) : The probability that F n , which is generated according to 
P(y\xi,x 2 ) = P(y\xi,X2,u, z), is jointly typical with x 2 , which was generated according to P(x 2 \z 2 , u) = 
P(x 2 \u, zi, z 2 , xi), where (x™, z™, z 2 , u") € X"i n '(Xi, Zi, Z 2 , £7) is bounded by (LemmaO 

Pr{(x5 l ,z^x 2 l ,z™,M™,y™) e r e ^|«,z",z 2 l ,u™) e r e (n) } < 2-™( / ( X2 ; F i Xi ^ l/ )-' 5 ( e ». (24) 

Hence, we obtain 

J2 Pr(^W,*,6) < 2 n ^'2-"( / ( X2;Y l Xl - Zl ' Z2 ^)- 5 ( e ». (25) 

1=1,3=1, fe>l 

• Upper-bounding ^ i=1 J>1 fe=1 Prf-E^^): Similarly, to (|23T > we obtain 

E Pr (^\M) < 2™ fl "2-™( 7 ( Xi;y l x - Zl ^ 2 ' C/ )-' 5 ( e )). (26) 
i=i,j>i,&=i 

. Upper-bounding Z)i=i lJ >i,jfe>i P*{Ei,j,k,b) by 

E PT ( E iJ,k,b) < 2^ R 2+ R "h' n ^^ x ^ z ^ z -^- s ^l (27) 

i=l,j>l,fc>l 

. Upper-bounding Ei>i,j>i,fc>i Pr(#i,j,fc,&) b y 

V" Pr(E ijk b) < 2 niR " +R ' 1+R2 h~ n{I{X2 < Xl - u - Zl < Z2 < Y) ~ 5ie V 

i>l,j>l,k>l 
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= 


2n{R 1 +R 2 -I(X 2 ,X 1 ;Y)-S(e)) 




= Ri 


-R'l 


, R'(, R' 2 = R 2 - R 2 , R'£ and R 2 satisfy 


Ri 


-R'l 


< 


H(Zx\U), 


R2 




< 


H(Z 2 \U), 




Ri' 


< 


I(Xt-Y\Xo Zi II) 




K 


< 


I{X 2 -Y\X U Z 2 ,U), 


R'l 


+ R'i 


< 


I(X 1 ,X 2 ;Y\Z 1 ,Z 2 ,U), 


Ri 


+ R2 


< 


I(X 2 ,X i; Y), 



(28) 



(29) 

then there exists a sequence of code with a probability of error that goes to zero as the block length goes to infinity. 
Using Fourier— Motzkin elimination 1(171 first for R'l we obtain 

R 1 -H{Z 1 \U) < I&nYlX^ZuU), 
R2-R2 < H(Z 2 \U), 

R 2 < I(X 2 ;Y\X U Z 2 ,U), 
R 1 -H{Z 1 \U) + R! 2 ' < I{X X ,X 2 ;Y\Z U Z 2 ,U\ 

R1+R2 < I{X 2 ,X V ,Y), (30) 
and applying Fourier— Motzkin elimination also for R 2 we obtain 

Rx-HiZ^U) < I{X X ;Y\X 2 ,Z X ,U), 

R 2 -H{Z 2 \U) < I(X 2 ;Y\X U Z 2 ,U), 

R 1 -H(Z 1 \U) + R 2 -H(Z 2 \U) < I(X U X 2 ;Y\Z U Z 2 ,U), 

R1+R2 < I(X 2 ,X i; Y), (31) 

which is equivalent to the region of Case A in (0. ■ 
Achievability for Case B: The achievability of case B is very similar to case A, only that the codewords of X 2 
needs to be generated according to shannon strategy (or a code-trees ) rather than codewords. This is due to the 
fact that Z\ y i is known causally and X 2 is generated according to a distribution P(x 2 \u, z\). ■ 

V. COMMON MESSAGE 

Let us now consider the case where a common message, mo G {1,2, ...,2 nR °}, is known to encoders 1 and 2 
and needs to be transmitted to the decoder in addition to the private messages m,\,m 2 . Hence Encoder 1 is given 
by the function 

Case A, B, : {1, 2 nRo } x {1, 2 nRl } x Z'if 1 H> X^j, (32) 
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and Encoder 2 is given by the functions 

Case A, f 2>i : {1, 2 nR °} x {1, 2 ni?2 } x Z\~ x ^ X hi , 

CaseB, f 2ji : {1, .... 2 nR °} x {1, 2 nR *} x Z{ ^ X lfi . (33) 

Remarkably, no additional auxiliary random variable is needed to characterizes the capacity region, since the partial 
cribbing is used for generating a common message. Let the rate regions 1Z A and TZ% be defined exactly as TZa and 
TZb only that the last inequality in 0, i.e., R\ + R 2 < I(X\, X 2 ;Y), is replaced by 

R + Ri+R 2 <I(X 1 ,X 2 ;Y). (34) 

Theorem 5 (Capacity region in the case of a common message): The capacity regions of the MAC with strictly- 
causal (Case A), and mixed causal and strictly-causal (Case B) partial cribbing with a common message are 1Z A 
and IZg, respectively. 

Note that if there is no cribbing, i.e., Z\ and Z 2 are constant, we obtain the capacity region of the MAC with a 
common message as derived by Slepian and Wolf |fl8l . We sketch here only the differences between the proof of 
Theorem [5] and Theorem Q] 

Proof of Theorem \5\ 

Converse: Similar to the sequence of inequalities in (TlOb we have 

n{R +Ri + R 2 ) = H(Mq, M x ,M 2 ) 

n 

< Yl I( < X hh x ^ Y i)+ n ^ (35) 

i=l 

Adding conditioning on Mo in the sequence of inequalities ( fTTb we obtain 

n{R l +R 2 ) = H{M X ,M 2 ) 

= H{Mx,M 2 \M Q ) 

n 

< J2 H ( Z hi> Z 2 4Z\-\Z l 2 -\M Q ) + I(X lti ,X 2in ; Yi\Z\,Zl M ) + ne n , 
i=i 

n 

= Y, H ( Z hh z 2AUi)+I{X hi ,X 2tn -,Y i \Z lti ,Z 2ti ,U i ) + ne n , (36) 
i=i 

where the last step is due to the new definition of Ui as 

Ui ± (Mo^t^Zt 1 ). (37) 
Similarly, adding conditioning on Mo in the sequence of inequalities ( fL3l we obtain 

ni?i = ^(Mi) 

= fT(Mi|M 3 ,M ) 

n 

< ]T H{Z lii \Zi- 1 ,Zt 1 ,M ) + /(V,:.Y,., X,,. Z{, Z l 2l M ) + ne n 

i=l 



12 

n 

= J^H(Z lii \U i )+I{Y i ;X hi \X 2t i,U i ,Z 1 , i )+ne n , (38) 

i=l 

In a similar way, we obtain the inequality for R 2 as in (TBI) . 

Achievability: The achievability proof is similar to that in Theorem [T] except that we generate 2 n ( R i +R 2 +Ro * > 
codewords u n according to i.i.d. ~ P(u), rather than 2 n ^ Rl+R ' 2 \ and wherever we have in the achievability proof 
of Theorem Q] (m^ m' 2 we should now have (mo, w! x b _ v m' 2 Hence we obtain the same sequence 
of inequalities as in ( 1291 except that in the last inequality which corresponds to an error in all messages we have 

R + Ri+R 2 <I(X 2 ,X 1 ;Y). (39) 



VI. Special case of partial cribbing: Semi-deterministic relay channel 

As a special case of the partial cribbing encoders, let us consider the case where Encoder 2 has no message to 
send, i.e., R 2 = 0, and only Encoder 2 cribs from Encoder 1, i.e., Z 2 is a constant. We show here that indeed 
the region obtained via partial cribbing when R 2 = and the region obtained via semi-deterministic relay channel 
coincide. 

Case A, semi-deterministic relay with a delay: This case become a special case of the semi-deterministic relay 
channel which was introduced and solved by El-Gamal 0, where Encoder 2 plays the role of the relay. In such a 
case the region 1Z a becomes 

' R 1 <H{Z 1 \U)+I{X 1] Y\X 2 ,Z U U), 
Rx < I(X 1 ,X 2 ;Y\U,Z 1 ) + H(Z X \U), 
i?i < I(X 1 ,X 2 ;Y), for 
^ P(u)P(z 1 \u)P(x 1 \z 1 ,u)P(x 2 \u)P(y\x 1 ,x 2 ). ^ 
Clearly, H(Zx\U) + I(Xi;Y\X 2 , Z u U) < I{X X , X 2 ; Y\U, Z x ) + HiZ^U) hence the region we obtained is R x < 
min(H(Z 1 \U)+I(X 1 ;Y\X 2 ,Z 1 ,U),I(X 1 ,X 2 ;Y)) for some P(u)P(z 1 \u)P(x 1 \z 1 ,u)P(x 2 \u). Now consider 



(40) 



HiZ^U) + IiXx-Y^Z^U) 



(a) 



(h) 



H(Zx\U, X 2 ) + I{X r ,Y\X 2 , Z U U) 



< H(Z 1 \X 2 ) + I(X 1 ;Y\X 2 ,Z 1 ), 



(41) 



where step (a) follows from the Markov chain X 2 — U — Z\ and step (b) from the fact that conditioning reduces 
entropy and from the Markov chain Y — (Xi, Zi,X 2 ) — U. By choosing U = X 2 we obtain the upper bound of 
(PiTT i and the expression I(X±,X 2 ;Y) does not decrease. Hence the capacity region is 



Rx < miniHiZtlX^ +I(X 1 ;Y\X 2 ,Z 1 ),I(X 1 ,X 2 ;Y)) 
for some P(x±, x 2 )- Eq. (l42l coincides with the result in 0. 



(42) 



Case B, semi-deterministic relay without delay: In this case 1Z b become the set of rates i?i that satisfies 

Rx KmmiHiZ^U) + IiX^Y^Z^JiX^X^Y)) (43) 
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for some P(xi, z x , u)P(x2\u, z x ). The case of relays without delay was investigated by El-Gamal et. al. in |[T9l 
where it was shown that the capacity region for the semi-deterministic relay without delay which is denoted by 

Co 

,semi-det IS 

C .semi-det= ma X/ min(I(X i; Y, Z X \U), I(U, X x ; Y)). (44) 

P{U, Xi),X2 — f[U.Zi) 

At first glance, the expressions in (l4Jt seem to be different from the expression in (04), but with some simple 
manipulations one can show that the expression are equivalent. In particular, the first term in (04} may be written 

as 

I(X X ;Y,Z X \U) = I(X X ;Z X \U) + I(X X ;Y\U,Z X ) 
( = ] H(Z X \U)+I(X X ;Y\U,Z X ) 

( = } H(Z X \U)+I(X X ;Y\U,Z X ,X 2 ), (45) 

where step (a) follows from the fact that Zi is a function of Xi and step (b) from the fact that X 2 is a function 
of (U, Z\). The second term in d44i i may be written as 

I(U,X X ;Y) ( = } I(U,X X> X 2 ;Y) 

( = ] I(X X ,X 2 ;Y), (46) 

where step (a) follows from the fact that X 2 is a function of (U, X x ) and step (b) follows from the Markov chain 
Y — (Xi , X 2 ) — U. Now, to conclude that (T43b and d44l i are equivalent we need to show that it suffices to consider 
only distributions where X 2 is a function of (U, Z\) in (1431 . It follows from ll20l Lemma 1] that there exists a 
random variable W independent of (C7, Z\) and satisfies W — (X 2 , U, Z\) — (Y, Xi) such that X 2 is a deterministic 
function of (U, Z x , W). Therefore 

H(Zx\TJ)+I{Xi;Y\X 2 ,Z x ,U) = H{Z X \U : W) +/(X 1 ;F|X 2 ,2 1 ,[/,^) 

= H(Zx\U) + I{X x ;Y\X 3 ,Z u U), (47) 

where U = (U, W). Hence it suffices to consider X 2 that is a function of (U,Z X ) and it emerges that ( |43l l is 
equivalent to (l44l . 

VII. Gaussian MAC with quantized cribbing 

In this section we consider the additive Gaussian noise MAC, i.e., Y = X x +X 2 + W, where W is a memoryless 
Gaussian noise with variance N, i.e., W ~ Norm(0, N). We assume a power constraints Pi and P 2 on the inputs 
from Encoder 1 and Encoder 2, respectively. If the encoders do not cooperate than the capacity is given by 

Rr < 5 l0g ( 1 + £) 

R, < 5log(i + |) 

1 / Pi+P 2 \ 
Ri+R 2 < ^log f 1+ \ j. (48) 
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If there is perfect cribbing from Encoder 1 to Encoder 2, either with delay or without the capacity is the same as 



W ~Norm(0, N) 



mi 



e{i,...,2"^} 



Encoder 1 



Scalar 
Quantization 



rs Y 



Decoder 



mi(y ") 

m 2 (r™) 



m 2 



G {!,..., 2"^} 



Encoder 2 



X 2 ,i(m2,Z*) 



Fig. 2. Gaussian MAC with quantized cribbing. The cribbing that Encoder 2 observes is the quantized signal from Encoder 1. There exist 
power constraints £?=i E i X ti\ < P i and £"=1 «] < p 2- 



if Encoder 2 knows the message of Encoder 1 since Encoder 1 can send the message in one epoch time. Hence, 
the capacity is the union over < p < 1 of the regions 

R2 < 5 1 °s( 1 + §( 1 -P 2 ») 
+ < llog(l + P ' +2 ^ +P - ). (49) 

Now, let us consider the case where Encoder 2 observes a quantized version of the signal from Encoder 1 without 
delay. The setting is depicted in Fig. [2] We assume that the quantizer is a scalar quantizer designed such that under 
a Gaussain input with variance P± = 1 the discrete values have the same probability (see Fig. [3] for an example of 
2-bit quantizer). 
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Fig. 3. The 2-bit quantizer's boundaries are designed such that if the input signal has a normal distribution with variance Pi = 1 the output 
values from the quantizer have equal probability. The input to the 2-bit quantizer is Xi and the output is Q 6 {1, 2, 3, 4}. 



Next, we consider a simple achievable scheme for the Gaussian MAC with a quantizer cribbing without delay, 
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where the power constraints are Pi = P2 = 1 and the noise variance is N = h. We evaluate the region TZb given 
by (0 and ([8]) for the case where U\, U2, Z2 are constants, X\ ~ N(0, 1), Z\ is a quantized version of X\ such that 
each value has equal probability. The input distribution is Px 2 \Z! (^2^1) = pPv{^2) + (1 — p)Px 1 \z 1 (%2\zi)> where 




Fig. 4. Achievable regions of Gaussian MAC with a quantizer cribbing. 

V ~ N(0, 1) and is independent of X\ and Z. Note that under these assumptions X2 ~ iV(0, 1) and therefore 
satisfies the power constraint. Fig. |4]depicts the simple achievable scheme for different quantizers. The blue line in 
Fig. S] is the capacity region where there is no cribbing, evaluated according to (l48l i. The red line is the capacity 
region where there is perfect cribbing, evaluated according to ( |49| i. The lines in between are achievable regions 
according to the simple scheme we have described above. One can see that the main gain is already due to 1-bit 
quantizer and that the difference between the achievable scheme with a 4-bit quantizer and the capacity region 
where there is perfect cribbing is negligible. 

VIII. CONTROLLED CRIBBING 

Here we consider the case where the cribbing is controlled by an action which depends on previously cribbed 
signals. In this study, only Encoder 2 cribs causally or strictly causally. More precisely, at time i there is a controller 
which takes action an and the cribbed signals from Encoder 1 to Encoder 2 at time i is z\i = f{xi.ii a i.i) as 
shown in Fig. [5] The action at time i depends on past cribbed observation, i.e., a\ i(z l {~ ) and the action is a limited 
resource, namely, there is a restriction that — YHi=i < T, where A(ai) is a cost of taking action a\. 

Let us now formally define a controlled code. 

Definition 2: A (2 nRl , 2 nR2 , n) code with controlled partial cribbing , as shown in Fig. [5] consists at time i of 
an encoding function at Encoder 1 

Case A, B, /;., : {1 2 nRl } h-> X lti , (50) 

and an encoding function at Encoder 2 that changes according to the following case settings 

Case A : {1, 2 nR *} x Z\~ x h+ X lti , 
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Fig. 5. Partial cribbing with actions. The action at time i is ai ? j and is determined by previous cribbed observations i.e., z\ . The cribbed 
signal z\i from Encoder 1 to Encoder 2 is given by the deterministic function Zi j = gi(oi j, xi j). There exists a constraint on the actions 
of the form I E?=i S[A(Ai,<)] < I\ 



CaseB / 3)i : {1, 2" fl2 } x ZJ^ Xi 



and a controlled action 



and a decoding function, 



9i, 



zr 1 1— > 



ft : y" i-> {l,...,2 nKl } x {!,..., 2" K2 } 



(51) 



(52) 



(53) 



The code needs to satisfy the constraint — Y^7=i E[A\(Ai : i)] < T\. The probability of error, achievable pair-rates 
and capacity region are defined in the usual way for MAC as presented in Def. Q] 

Let us now define the following regions TZ a Al TZ%, which are contained in namely, contained in the set of 
non negative two dimensional real numbers. 

Ri < H(Zi\U,Ai) + I(X 1 ;Y\X 2 ,Z 1 ,U,A 1 ), 
R 2 <I(X 2 -Y\X 1 ,U,A 1 ), 

R 1 +R 2 <I(X U X 2 ;Y\U,A 1 ,Z 1 ) + H(Z 1 \U,A 1 ), 
Ri+R 2 < IiX^X^Y), for 

B(u, ai)P(x u zi\u, ai)B{x 2 \u, a-i)P{y\x u x 2 ) s.t. £[A x (Ai)] < Y x . 
The region 1Z% is defined with the same set of inequalities as in d54l l. but the joint distribution is of the form 

B(u,a 1 )B(x 1 ,z 1 \u,a 1 )B(x 2 \z 1 ,u,a 1 )P(y\xi,x 2 ) s.t. E[A(Ai)] < T. (55) 

Theorem 6 (Capacity region): The capacity regions of the MAC with actions and with strictly-causal (Case A), 
and mixed causal and strictly-causal (Case B), as described in Def. |2j are 11% and 71^, respectively. 

The proof is based on minor modification of the proof of the capacity region of the MAC with partial cribbing 
presented in Theorem Q] 
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Proof: 

Achievability: Consider the achievability proof of Theorem Q] and just replace Ui by the pair (Ui,Aii). Note 
that the proof holds since at the end of block b the controller is able to decode b . 

Converse: Consider the converse proof of Theorem Q] and just replace {/,-. Note that Ui = Z^ 1 . since Ai is a 
function of Zp 1 its also a function of Ui and by replacing Ui by Ui, An we obtain the converse proof ■ 

Example 1 (Deterministic Relay with actions): Consider the case where only Encoder 1 has a message to transmit 
and Encoder 2 has no message of its own to transmit, but helps to increase the rate of Encoder 1 . Encoder 2, which 
plays the role of a relay, takes an action Ai that is a function of the observed signal up to time i — 1, i.e., Z l ~ l . 
If Ai = 1, then Zi = Xi, and otherwise Zi is a constant. The cribbing signal Z± is observed at Encoder 2 with 
a delay. There exists a constraint that i Y^i=i E\Ai[ — In addition, Encoder 2 transmits a signal X 2 ^ through 
the channel at time i, where X^i is a function of Z % ~ x . The output channel Y is randomly chosen with equal 
probability to be either X\ or X 2 . This example is illustrated in Fig. [6] and is a special case of the setting presented 
in Fig. 
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Fig. 6. An example of detenninistic cribbing with actions. The relay (Encoder 2) take an action A{ at time i that depends on previous cribbing, 
i.s., Z z ~ 1 . The cribbing signal Zi equals to X\ t i if Ai = 1 and is constant otherwise. The cribbing is a limited resource hence there exists a 
constraint that on the portion of time that Encoder 2 can crib the signal from Encoder 1, namely, — ^[-^i] ^ r. The output channel Y 

is randomly chosen with equal probability to be either X\ or Xi 



The next lemma establishes the capacity region of a deterministic relay with actions which is a special case of 
the cribbing with actions. 

Lemma 7: The capacity region of partial deterministic cribbing with actions where only Encoder 1 sends a 
message, i.e., i?2 = and there exists a delay in the cribbing (Case A) is 

Rl= max mm{H(Z\X 2 ,A) + I(X 1 ;Y\X 2 ,Z 1 ,A),I(Y;X 1 ,X 2 )}. (56) 

Px l ,x 2 ,A-E[c{A)]<T 

If there is no delay in the cribbing (Case B), i.e., X 2t i{Z % '), then 



i?i = max mm{H(Z\U,A)+I(X 1 ;Y\X2,Z,U,A),I(Y;X 1 ,X 2 )}. 

Pu,x 1 ,aPx 2 iu,z,a-E[c(A)]<T 



(57) 
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Proof: Since R 2 = follows from (O that 

Ri < maxmia{H(Z\U,A) + I(X 1 ;Y\X 2 ,Z,U,A),I(X 1 ,X 2 ;Y)}. (58) 

For the case where there is a delay in the cribbing (case A) the set of joint distributions V is of the form 
P(u, a, xi)P(x 2 \u, a)P(y\x\, x 2 ) and Z is a function of A and X. Using mathematical manipulation on the first 
term in the minimum in d58l we obtain 

Ri < H(Z\U,A,X 2 ) + I(X 1 ;Y\X 2 ,Z,U,A) 

(b) 

< H(Z\A,X 2 )+I(X i; Y\X 2 ,Z,A), (59) 

where step (a) follows from the Markov chain X 2 — (U,A) — X\ — Z and step (b) from the fact that conditioning 
reduces entropy and the Markov chain Y — {X\, X 2 , Z a) — U . By choosing U = X 2 the first term of (l58~t become 
the upper bound in ( 1591 ; hence (l56l l is the capacity region. 

In the case that there is no delay in the cribbing the capacity region is simply d58l where the set of joint 
distribution V is of the form P(u, a, Xi)P(x 2 \u, a, z)P(y\x\, x 2 ) and z is a deterministic function of a and x. ■ 

For the case of delay in the cribbing, the action Ai can be seen as part of the output signal from Encoder 2 to 
the channel, and indeed by replacing X 2 in d42l with (X 2 , A), we obtain (|56*T l. However, in the case of no delay in 
the cribbing i.e., X 2 (Z l ), the replacement of X 2 is not possible since the action must have a delay i.e., A;(Z i_1 ). 

For obtaining a numerical solution when there is a delay in the cribbing, namely, evaluating (l56l l for the example 
in Fig. [6] we can assume without loss of optimality that 





Pi(A 


= 1) 


= r, 


Pr(X! 


= X 2 \A 


= 0) 


= a 




= X 2 \A 


= 1) 


= ai 



The reason one can assume that Pr(A = 1) = T is because if this is not the case, and one has a code where 
the portion of Pr(yl = 1) is smaller than T, then one can add actions A = 1 for some portion of time without 
decreasing the performance of the code. Furthermore, since the channel is symmetric with respect to and 1 (by 
exchanging and 1 for the inputs to the channels the performance of the code remains the same) only the probability 
Pr(Xi = X 2 ) is important. Furthermore, from the same reasons one can also assume that P(x\) and P{x 2 ) are 
Bernoulli(i) without loss of optimality. Now we shall compute the terms in ( l56l l 

I(Y;X 1 ,X 2 ) = H(Y)-H(Y\X U X 2 ) 

= i_r + oir-(i-r)(i-ao) 

= air + oo(l-r), (61) 



H(Z\X 2 ,A) 



= rifb(ai), 



(62) 
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I(X i; Y\X 2 ,Z,A) = H(Y\X 2 ,Z,A)-H(Y\X 1 ,X 2: A) 

= r(l - ax) + (1 - T)H b - r(l - a x ) - (1 - r)(l - a ) 

= (l-r)(ff 6 (i±^+ao-l), (63) 

where step (a) in (US is due to the fact that Pr(Y = X 2 \X 2 , a = 0) = a + and therefore ii"(Y|X 2 , Z, A) = 
r(l — ax) + (1 — r)ff;,( 1+ 2 a " ) where H b {p) is the binary entropy, i.e., — plogp — (1 — p) log(l — p) for < p < 1. 
Hence the capacity of the setting in Fig. [6] as a function on the constrain of the action T is 

C(T)= max imn(TH b ( ai ) + (1 - T) ( H b ( ^-^) + a - l) , + a (l - T)). (64) 
o<q ,qi<i \ \ z / y 

The capacity C(r) is depicted in Fig. [7] and can be found simply using a grid-search on < ao,cti < 1 or by 




0.2 0.4 0.6 0.8 1 

r 



Fig. 7. Capacity of setting in Fig. [6] as a function of the action constraint T. For the case where T = the capacity can be solved analytically 
since it is the capacity of the Z channel. The capacity where T = 1 is the simple expression max ai min(cei, Hb(ai)) which can be solved 
numerically by solving a = H^ia). 



convex optimization tools. In the case that T = 0, X 2 ^ is independent of the message toi and therefore we obtain 
that at any time i the channel from Encoder 1 to the output behaves as a Z— channel if X 2 ^ = and as an S 
channel if X 2 ^ ~ 1 and the capacity of those two channels are H b (^) — |, and therefore C(0) = H b (^) — |. 
For the case that r = 1 we obtain from d64l i that C(l) = max Ql min(ai, H b (ai)). The a that maximizes the 
expression of C(l) is the one that solves the equation a\ = Hb(ai). 

IX. Conclusions and further research directions 

We have considered the problem of MACs with partial cribbing encoders, namely, in a two encoder MAC the 
observed cribbed signal is a deterministic function of the other encoder output. We have characterized the capacity 
region for the two cases where the partial cribbing is causal or strictly causal. Rate splitting is the main additional 
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technique used in the achievability proof over the techniques used for perfect cribbing. The extension of perfect 
cribbing to partial cribbing resemble to the extension of the decode-and-forward technique for the relay to the 
partial-decode-and-forward technique 0151 . The method we used for partial cribbing may be also used for noisy 
cribbing, although in general the capacity region of noisy cribbing is an open question. Another question that has not 
been solved yet is the non causal partial cribbing. For the perfect cribbing case Willems lfl6l solved the noncausal 
case simply by showing that causal and non-causal perfect cribbing results in the same capacity region. 

Solving the partial cribbing setting allowed us to solve an action dependent cribbing problem. In this paper we 
considered the case where the action is only a function of the previously observed cribbing. However, the case in 
Fig. [5] where the action is a function of the previously observed cribbing and the message of the cribbing encoder, 
i.e., aii(z\~ , mi) is yet to be solved. Issues of this nature may be raised in the sphere of cognitive communication 
systems where sensing other users' signals is a resource with a cost. 
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